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-^-J Abstract. We extend the DuBois-Reymond necessary optimality condition 

and Noether's symmetry theorem to the time delay variational setting. Both 
Lagrangian and Hamiltonian versions of Noether's theorem are proved, cover- 
ing problems of the calculus of variations and optimal control with delays. 

1. Introduction. The concept of symmetry plays an important role in Physics and 
if*. [ Mathematics [22]. Symmetries are described by transformations that applied to a 

iy-\ ■ system result in the same object after the transformation is carried out [13]. They 

\& \ are described mathematically by parameter groups of transformations [12]. Their 

importance ranges from fundamental and theoretical aspects to concrete applica- 
£f) \ tions, having profound implications on the dynamical behavior of systems and on 

their basic qualitative properties [23] . Another fundamental notion is the concept of 
a conservation law [11]. Typical applications of conservation laws in the calculus of 
variations and optimal control involve reducing the number of degrees of freedom, 
thus reducing the problem to a lower dimension and facilitating the integration of 
the differential equations given by the necessary optimality conditions [20, 21]. 
All differential equations in physics have a variational structure. In other words, 
C$ ■ the equations of motion of a physical system are the Euler-Lagrange equations of a 

certain variational problem. It turns out that the conservation laws are the result of 
invariance of the action with respect to a continuous group of transformations, given 
by some symmetry principle. The more general expression of the interrelation be- 
tween symmetry/variational structure/conservation is given by Noether's theorem. 
Noether's theorem asserts that the conservation laws for a system of differential 
equations that correspond to the Euler-Lagrange equations of a certain variational 
problem come from the invariance of the variational functional with respect to 
a parameter continuous group of transformations [24]. In the last few decades, 
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Nocther's principle has been formulated in various contexts: see [2, 5, 7, 8, 9, 17] 
and references cited therein. Here, we generalize Nocther's theorem to variational 
and control problems with time delay. 

Variational and control systems with delays in the state and/or control variables 
play an important role in the modeling of phenomena in various applied fields [3] . 
The research literature dedicated to the calculus of variations and optimal control 
with delays is vast but, to the best of our knowledge, it does not include a Noethcr 
theorem. For a gentle introduction to control problems with time delay we refer the 
reader to the classical references [15, 18]. Optimal control problems with delays in 
the state and control variables, subject to mixed-state and control-state constraints, 
are studied in [4, 10, 16]. 

This article is organized as follows. In Section 2 we review one of the proofs of 
the Noether symmetry theorem. In Section 3 we use the Euler-Lagrange equations 
with time delay and respective extremals to prove an extension of Nocther's theo- 
rem for problems of the calculus of variations (Theorem 3.7) and optimal control 
(Theorem 3.13) with time delay. The results are proved by first extending the clas- 
sical DuBois-Reymond necessary optimality condition to the calculus of variations 
and optimal control with time delay (Theorem 3.6 and Theorem 3.10, respectively). 
Two illustrative examples showing the application of our main results are given in 
Section 4. 

2. Review of the Classical Noether's Theorem. There are several different 
ways to prove the classical Nocther's theorem [6]. In this section we review one 
of these proofs. In Section 3 we then show how this approach can be extended to 
problems with time delay. We begin by formulating the fundamental problem of 
the calculus of variations: to minimize 

l[q{-)]= f L(t,q(t),q(t))dt (1) 

J a 

under given boundary conditions q(a) = q a and q(b) = qt,, and where q = -§. The 
Lagrangian L : [a, b] x W 1 x M. n — > R is assumed to be a C^-function with respect 
to all arguments, and admissible functions q(-) are assumed to be C 2 -smooth. 

Definition 2.1 (Invariance of (1)). Consider the following s-parameter group of 
infinitesimal transformations: 

(t = t + sri(t,q)+o{s), 

\q(t)=q(t)+st(t,q)+o(s), 

where rj e C 1 (R 1+n ,M) and £ G C 1 (R 1+ ",R™) are given functions. The functional 
(1) is said to be invariant under (2) if 

" L(t,q(t),q(t))dt= f ' L(i,q(i),q(t))di (3) 

t a Jt(t a ) 

for any subinterval [i a ,t(,] C [a, 6]. 

Throughout the text we denote by diL the partial derivative of L with respect 
to its ith argument, i = 1,2,3. 

Theorem 2.2 (Necessary condition of invariance). If functional (1) is invariant 
under transformations (2), then 

d 1 L(t,q,q)r) + d 2 L(t,q,q)-Z + d s L(t,q,q)-(t-qf J ) + L(t,q,q)fi = . (4) 
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Proof. Since (3) is satisfied for any subintcrval [i a ,if,] of [a,b], one can remove the 
integral sign in (3) and write the equivalent equality 

t r. .\ r I , / x ^ , , 9 + s( + o(s) \ di 

L{t,q,q)=L[t+ sr) + o(s),q + s£ + o(s), * ' - . 5) 

\ 1 + sr] + o(s) I at 

Equation (4) is obtained differentiating both sides of condition (5) with respect to 
parameter s and then putting s = 0. □ 

Definition 2.3 (Eulcr-Lagrange extremal). A function q(-) G C 2 is said to be an 
extremal of (1) if it satisfies the Euler-Lagrange equation 

j t d 3 L(t,q(t),q(t)) = d 2 L(t,q(t),q(t)), t G [a,b]. (6) 

Definition 2.4 (Constant of motion/conservation law) . A quantity C(t,q(t),q(t)) 
is said to be a constant of motion for (1) if 

±C(t,q(t),q(t)) = 0, (7) 

t G [a,b], along all extremals q(-) of (1). The equality (7) is then a conservation 
law. 

Theorem 2.5 (DuBois-Reymond necessary optimality condition). If function q(-) 
is an extremal of functional (1), then 

BtL (t, q(t), q(t)) = j f {L (t, q(t),q(t)) - 3 3 L (t, q(t),q(t)) ■ q(t)} . (8) 

Proof. Follows by direct calculations, using the Euler-Lagrange equation (6): 

— {L(t,q,q) -d 3 L(t,q,q) ■ q} 

= d 1 L(t,q,q)+q- ( d 2 L (t, q, q) - -^d 3 L (t, q, q) 
= d 1 L(t,q,q) . 

Theorem 2.6 (Noethcr's theorem). // (f ) is invariant under (2), then 
C(t, q, q) = d 3 L (t, q, a) ■ £(i, q) + (L(t, q, q) - d 3 L (t, q, q) ■ a) t](t, q) 

is a constant of motion. 

Proof. We use the Euler-Lagrange equation (6) and the DuBois-Reymond neces- 
sary optimality condition (8) into the necessary condition of invariance (4): 

= diL (t, q, q) r\ + d 2 L (t, q,q) ■ £ + d 3 L (t, q, q) ■ (i - grA + L (t, q, q) i] 

= d 2 L (t, q,q)-£ + d 3 L (t, q,q) ■ £ + d x L (t, q,q)V + V ( L (t, q, q) - d 3 L (t, q, q) ■ q) 

= ^ d 3 L (*) Q, V) ■ € + d 3 L (*> q,q)-i+-^ t {L (t, q, q) - d 3 L (t, q, q) ■ q} n 
+ V (L (t, q, q) - d 3 L (t, q, q) ■ q) 

= - {d 3 L (t, q,q)-Z+ {L{t, q, q) - d 3 L (t, q, q) ■ q) V } . 

n 



n 



4 GASTAO S. F. FREDERICO AND DELFIM F. M. TORRES 

3. Main Results: Noether type theorems with time delay. In Section 3.1 we 
prove two important results for variational problems with time delays: a DuBois 
Rcymond necessary optimality condition (Theorem 3.6) and a Noether theorem 
(Theorem 3.7). The results are then extended in Section 3.2 to the more general 
optimal control setting with delays. 

3.1. Calculus of variations with time delay. We begin by formulating the 
fundamental problem of the calculus of variations with time delay: to minimize 

l T [q{-)]= ^ L(t,q(t),q(t),q(t-T),q(t-T))dt (9) 

subject to 

q(t) = 5(t), te[h-T t t x ], (10) 

where the Lagrangian L : [ti,t 2 ] x M" x R n x R™ xl"->l is assumed to be a 
C 1 -function with respect to all its arguments, admissible functions q(-) are assumed 
to be C 2 -smooth, t\ < t 2 are fixed in R, r is a given positive real number such that 
t < t% — ti, and 8 is a given piecewise smooth function. 

Notation. For convenience, we introduce the operator [-] r defined by 

[q] T (t) = (t, q{t) 7 q{t) 7 q{t - T ) 7 q{t - r)) . 

Theorem 3.1 (Euler-Lagrange equations with time delay [1, 14]). If q(-) is a 
minimizer of problem (9)-(10), then q(-) satisfies the following Euler-Lagrange 
equations with time delay: 

f | {d 3 L[q] T (t) + d 5 L[q} T (t + r)} = d 2 L[q] T (t) + d 4 L[q] T {t + r), h<t<t 2 - t, 

\d_d 3 L[q] T (t) = d 2 L[q] T {t), t 2 -T<t<t 2l 

(11) 
where diL is the partial derivative of L with respect to its ith argument, i = 1, . . . , 5. 

Definition 3.2 (Extremals with time delay). The solutions q(-) of the Eulcr 
Lagrange equations (11) are called extremals with time delay. 

Definition 3.3 (cf. Definition 2.1). The functional (9) is said to be invariant under 
the s-parameter group of infinitesimal transformations (2) if 



d 

ds 



s=0Ji(I) 



t (+ . n m\ M , en n\\ gft) + sC(^gft)) 
L\t + sri{t, q(t)),q(t) + s£,(t, q(t)), - - . 



q(t - T ) + st(t - r, q(t - r)), ^ - r) + -<(t ~ ^(t -r)) + ^ 

l + sr){t-T,q(t-T)) J 

(12) 

for any subinterval / C [ii,^]- 

Theorem 3.4 establishes a necessary condition of invariance for (9). Conditions 
(13) and (14) are used in the proof of our Noether-type theorem (Theorem 3.7). 
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Theorem 3.4 (cf. Theorem 2.2). If functional (9) is invariant under the one- 
parameter group of transformations (2), then 



8iL[q] T (t)T)(t, g) + (%£[g]r(t) + diL[q] T (t + r)) • £{t, q) 



+ (d 3 L[q} T (t) + d 5 L[q] T (t + t)) ■ U{t iq ) ~ q(t)r,{t,q)) + L[q} T (t)r)(t,q) 



and 



dt = 
(13) 



d x L[q] T {t)r ] {t,q)+d 2 L[q] T {t)-^q) 

T 

+ d 3 L[q] T (t) ■ (e(t, q) - q(t)fl(t, q)) + L[q] T {t)f,{t, q)] dt = 0. (14) 
Proof. Without loss of generality, we take / = [ii,^]- Then, (12) is equivalent to 

d 1 L[q} T (t)r,{t,q) + d i L[q} T {t) ■&,<!) 
+ d 3 L[q] T (t) ■ U{t, q) - q(t)?)(t, q)) + L[q] T (t)f,(t, q) 



dt 



(15) 



d 4 L{q] T (t)-at-T,q(t-T)) 



+ d 5 L[q] T (t) -U(t- r, q(t - r)) - q(t - r)i)(t - r, q(t - r)) 



dt = 0. 



By performing a linear change of variables t = a + r in the last integral of (15), 
and keeping in mind that L[q] T (t) = on [t\ — r, t{\, equation (15) becomes 



&iL[q] T (t)ri(t, q) + (d 2 L[q] T (t) + d 4 L[q] T (t + r)) • £(i, g) 
+ (9 3 ^[g]r(«) + d 5 L[q] T (t + r)) • fe(t, q) - q(t)f,(t, q) 



L [l}r(t)r](t,(l) 



dt 



(16) 
r ai£[?]r(<)»7(t, 9) + 9 2 L[g] T (t) • £(*, g) 



+ 5 3 LM r (i)- (C(t,g)-g(t)j7(t,g)) +i[«]r(*)'7(t ) ?) 



di = 0. 



Taking into consideration that (16) holds for an arbitrary subinterval / C [^,£2], 
equations (13) and (14) hold. □ 

Definition 3.5 (Constant of motion/conservation law with time delay). We say 
that a quantity C(t, t + r, q(t), q(t — r), q(t + r), q(t), q(t — r), q(t + r)) is a constant 
of motion with time delay r if 

d 



dt 



C(t, t + r, q(t),q(t - r),q(t + T),q(t),q(t - r), q(t + r)) = 



(17) 



along all the extremals q(-) with time delay (cf. Definition 3.2). The equality (17) 
is then a conservation law with time delay. 

Theorem 3.6 generalizes the DuBois-Reymond necessary optimality condition 
(cf. Theorem 2.5) to problems of the calculus of variations with time delay. 
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Theorem 3.6 (DuBois-Rcymond necessary condition with time delay). If q(-) is 
an extremal with time delay, then it satisfies the following conditions: 

j t {L[q] T (t) - q(t) ■ (d 3 L[q] T (t) + d 5 L[q} r (t + r))} = 9ii[g] T (t) (18) 

for t\ < t < t% — T, and 

j t {L[q] T (t) - q{t) ■ d 3 L[q] T (t)} = d x L[q] T {t) (19) 

for t 2 — t < t < t 2 . 

Proof. We only prove the theorem in the interval t\ <t<t 2 —r (the proof is similar 
in the interval £2 — t < t < t^). We derive equation (18) as follows: 

2 I- [L[q] T (t) - q(t) ■ (d 3 L[q] T (t) + d 5 L[q] T (t + r))] dt 



t- dt 



*2 r 

diL[q] T (t) + d 2 L[q] T {t) ■ q{t) - d 5 L[q} T (t + t) ■ q\t) 



u 



j t {d 3 L[q] T (t)+d 5 L[q] T (t + T)}-q(t) 



(20) 



dt 



+ [ [d 4 L[q} T {t) ■ q{t -t) + d 5 L[q] T (t) ■ q\t - r)] dt. 

By performing a linear change of variables t = a + t in the last integral of (20), in 
the interval where t\ < t < t 2 — r, the equation (20) becomes 

2 j t [L[q] T (t) - q(t) ■ (d 3 L[q] T (t) + d 5 L[q] T (t + r))] dt 

T (&iL[q] T (t) + q(t)id 2 L[q] T (t) + d 4 L[q] T (t + r)) (21) 

ti K 
d 



lt [d 3 L[q] T (t) + d 5 L[q] T (t + t)] ■ q(t))dt. 

We finally obtain (18) by substituting the Euler-Lagrange equation with time delay 
(11) into (21). □ 

Theorem 3.7 establishes an extension of Noether's theorem to problems of the 
calculus of variations with time delay 

Theorem 3.7 (The Noether symmetry theorem with time delay in Lagrangian 
form). If functional (9) is invariant in the sense of Definition 3.3, then the quantity 
C(t, t + t, q(t),q(t - t), q(t + r), q(t), q(t - r),q(t + t)), defined by 

(d 3 L[q] T (t)+d 5 L[q] T (t + r))-at,q(t)) 

+ (L[q] T -q(t)-{d 3 L[q] T {t) + d b L[q] T {t + T)))v{t,q{t)) (22) 

for t\ < t < t 2 — t and 

d 3 L[q] T (t) ■ f(t,g(t)) + (L[q] T - q(t) ■ d 3 L[q] T (t))r)(t, q(t)) (23) 

for t 2 — t <t < t 2 , is a constant of motion with time delay (cf. Definition 3.5). 
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Proof. We prove the theorem in the interval t\ < £ < £2 — t. The proof is similar 
for the interval £2 — T < t < £2. Nocther's constant of motion with time delay (22) 
follows by using the DuBois-Rcymond condition with time delay (18) (similarly, 
(23) follows by using (19)) and the Eulcr-Lagrangc equation with time delay (11) 
into the necessary condition of invariance (13): 

rti— T r 

0= / 

•111 

+ {d 3 L[q] T (t) + d 5 L[q} T (t + r)) • (£(t, a) - q(t)f)(t, q)) + L[q} 7 

T f-| (d 3 L[q] T (t) + d 5 L[q] T (t + t)) ■ £(£, q) 
ti ldt 

+ (d 3 L[q] T (t) + d 5 L[q] T (t + r)) • £(t, q) 

+ j t {L[q] T {t) - q(t) ■ (dsL[q] r (t) + d 5 L[q] T (t + r))} r,(t, q) 



&L[g] T (t)»?(t, q) + (d 2 L[q\ T (t) + d A L[q] T {t + r)) • f (t, g) 



+ {i[«]r(t) - q(t) ■ (d 3 L[q] T (t) + d 5 L[q] T (t + r))} i)(t, q) 

t2 ~ T d_ r 
t. * 
+ (L[ ? ] r -g(t) • (5 3 L[g] T (£)+5 5 L[g] T (£ + r)) )j?(t,«(t)) 



1 dt = 0. 



(24) 



Taking into consideration that equation (24) holds for any subinterval / C [£1,^2]; 
we conclude that 

(d 3 L[q} T (t) + d 5 L[q} T (t + T))^(t,q(t)) 

+ (L[q] T - q(t) ■ (d 3 L[q] T (t) + d 5 L[q] T (t + r)))ry(£, q(t)) = constant. 

D 

3.2. Optimal control with time delay. Theorem 3.7 gives a Lagrangian formu- 
lation of Noether's principle to the time delay setting. Now we give a Hamiltonian 
formulation of Noether's principle for more general problems of optimal control with 
time delay (Theorem 3.13). The result is obtained as a corollary of Theorem 3.7. 
The optimal control problem with time delay is defined as follows: to minimize 

l T [q(-) 1 u(-)]= J" L(t,q(t),u(t),q(t-r),u(t-T))dt (25) 

subject to the delayed control system 

q(t) = V (t, q(t),u(t), q(t - r), u(t - r)) (26) 

and initial condition 

q(t) = S(t), te[h-T,h], (27) 

where <?(•) e C 1 ([£1 - r,i 2 ],R n ), u(-) £ C° ([h - T,£ 2 ],R m ), the Lagrangian L : 
[£1, £2] xl"xl m xl"xl™4l and the velocity vector (p : [£ x , £ 2 ] x R n x W n x 
R™ x R" 1 — > R™ are assumed to be C^-functions with respect to all their arguments, 
£1 < £2 are fixed in R, and r is a given positive real number such that r < £2 — £i- 
As before, we assume that 6 is a given piecewise smooth function. 
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Remark 1. In the particular case when cp(t,q,u,q T ,u T ) = u, problem (25)-(27) is 
reduced to the problem of the calculus of variations with time delay (9)-(10). 

Notation. We introduce the operators [•, -] T and [•, •, -] T defined by 

[g, u] T (t) = (t, q(t), u(t),q(t - t), u(< - r)) , 

where g(-) £ C 1 {[h - T,t 2 ],R n ) and u(-) 6 C° ([ti - T,t 2 ],R m ); and 

[q,u,p] T (t) = (t,q(t),u(t),q(t-T),u(t-T),p(t)) , 

where g(-) € C 1 ([h - r,t 2 ],R"), p(-) £ C 1 ([i 1; i 2 ],IR™), u(-) £ C° (fa - r,t 2 },R m ). 

Theorem 3.8 ([14]). If (q(-) , u(-)) is a minimizer of (25)-(27), then there exists a 
covector function p(-) £ C 1 ([ti, t 2 ],M n ) ,suc/i i/iaf the following conditions hold: 

• the Hamiltonian systems with time delay 

(q(t)=d 6 H[q ) u,p] T (t) _ 

|p(t) = -d 2 H[q,u,p] T (t) - 9 4j ff[g,ii,p] T (i + r) 



/or ii < t < i 2 — t, and 



9 6 i^[g, u,p]r(t) 
-9 2 H[g,u,p] r (t) 



(29) 



for t 2 — r < t < i 2 ; 
• the stationary conditions with time delay 

d 3 H[q,u,p] T {t) + d 5 H\q,u,p} T (t + t) = (30) 

for t\ < t < t-2 — t , and 

d 3 H[q lU ,p} T (t)=0 (31) 

fort 2 -T<t< t 2 ; 
where the Hamiltonian H is defined by 

H[q, U,p] T (t) = L[q, u] T (t) + p(t) ■ <p[q, u] T (t). (32) 

Definition 3.9. A triplet (q(-) , u(-) , p(-)) satisfying the conditions of Theorem 3.8 
is called a Pontryagin extremal with time delay. 

Remark 2. The first equation in the Hamiltonian system (28) and (29) is nothing 
but the control system with time delay q(t) — (p[q,u] T (t) given by (26). 

Remark 3. In classical mechanics, p is called the generalized momentum. In the 
language of optimal control [19], p is known as the adjoint variable. 

Remark 4. In the particular case when tp(t, q, u, q Tl u T ) = u, Theorem 3.8 reduces 
to Theorem 3.1. We verify this here in the interval t± < t < t 2 — t, the procedure 
being similar for the interval t 2 — r < t < t 2 . The stationary condition with time 
delay (30) gives p{t) = — d^L{q] T {t) — d^L[q] T {t + r) and the second equation in the 
Hamiltonian system with time delay (28) gives p(t) = — d 2 L[q] T (t) — d4L[q] T (t + r). 
Comparing both equalities, one obtains the first Euler-Lagrangc equation with 
time delay in (11). In other words, Pontryagin extremals with time delay (Defi- 
nition 3.9) are a generalization of the Euler-Lagrange extremals with time delay 
(Definition 3.2). 
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In classical optimal control, Theorem 2.5 (the DuBois-Reymond necessary op- 
timality condition) is generalized to the equality ^ = ^ [19]. Next, we extend 
Theorem 3.6 (the DuBois-Reymond necessary condition with time delay) to the 
more general optimal control setting with time delay. 

Theorem 3.10. If a triplet (q(-) , «(•) , p(-)) with q(-) e C 1 ([ti -T,t 2 ],M. n ), p{-) € 
C 1 ([ti , ^2] , K."), and u(-) £ C 1 ([£1 — T,t 2 ],M. m ) is a Pontryagin extremal with time 
delay, then it satisfies the following condition: 

-H[q,u,p] T (t) = d 1 H[q,u,p]r(t), te[h,t 2 \- (33) 

Proof. We prove condition (33) by direct calculations: 
f t2 d 

\diH[q,u,p] T {t) + d 2 H[q,u,p\ T {t) ■ q(t) + d 3 H[q,u 7 p] T (t) ■ u(t) 

(34) 

+ d 6 H[q,u,p} T {t)-p{t)]dt 

[diH[q,u,p] T {t) -q(t-T) +d 5 H[q,u,p] T {t) ■ ii(t - r)]dt 

and by performing a linear change of variables t = v + r in the last integral of (34) , 
equation (34) becomes 

J -H[q,u,p} T (t)dt 

f-t-2—T 

= / diH[q, u,p] T {t) + (d 2 H[q, u,p] r (t) + diH[q, u,p] T (t + t)) ■ q(t) 

Jtl L 

+ (d 3 H [q, U,p] T (t) + d 5 H[q, U,p] T (t + r)) • u(t) + d 6 H[q, U,p] T (t) ■ p(t)] dt 

t 2 r 

dxH[q, u,p] T (t) + d 2 H[q, u,p] T (t) ■ q{t) 

dt. 

(35) 



n 2 -T 
+ d z H[q, U,p] T (t) ■ u(t) + d 6 H[q, U,p] T (t) ■ p(t) 



We obtain condition (33) by substituting (28) and (30) into the first integral, and 
substituting (29) and (31) into the second integral of (35). □ 

Using the Lagrange multiplier rule, problem (25)-(27) is equivalent to minimizing 

J[q{-),u(-),p(-)]= [ [H(t,q(t),u(t),q(t-T),u(t-T),p(t))-p(t)-q(t)]dt (36) 

subject to (27), where H is given by (32). The notion of invariance for (25)-(26) is 
defined using the invariance of (36). 
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Definition 3.11 (cf. Definition 3.3). Consider the following s-parameter group of 
infinitesimal transformations: 

't = t + sr](t,q,u) + o(s), 

q(t) = q(t) + s£(t,q,u)+o(s), 

u(t) = u(t) + sg(t, q, u) + o(s), 
>P(t) = p(t) + s?(t, q, u) + o(s), 

where n e C 1 (R 1+ "+"\ R) , £,? G C* 1 (M 1+ ™+ m ,]R™), g G C*° ( 

given functions. The functional (36) is said to be invariant under (37) if 



d_ 
ds 



s=0 Jt(I) 



H\ t + sr), q + s£, u + sg, q(t — t) + s£ T (t), u(t — r) + sg T (t), 



(p + s<;)-i±^)(l + S fi) 
1 + sr] I 



dt = 



for any subinterval I C. [t 1 , i 2 ], where p T (i) = g(i — T, q(t — t), u(i — r)) and ^ T (i) = 
S(t-T,g(t-r),u(t-T)). 

Definition 3.12. A quantity C(t,q(t),q(t — T),u(t),u(t — r),p(t)), constant for 
t G [t\,t2\ along any Pontryagin extremal with delay (q(-) , u(-) , p(-)) of problem 
(25)-(27), is said to be a constant of motion with delay for (25)-(27). 

Theorem 3.13 gives a Nocther-type theorem for optimal control problems with 
time delay. 

Theorem 3.13 (The Noether symmetry theorem with time delay in Hamiltonian 
form). If we have invariance in the sense of Definition 3.11, then 

C(t, q{t),q(t - r), «(t), u(t - r), p(*)) = -?(<) ' S (*, ?(*), U W) 

+ H (t, q(t), u(t),q(t - T),u(t - r),p(t)) V (t, q(t),u(t)) (38) 

is a constant of motion with delay for (25)-(27). 

Proof. The constant of motion with delay (38) is obtained by applying Theorem 3.7 
to problem (36). □ 

Remark 5. The constant of motion with time delay (38) has the same expression 
in the two intervals t\ < t < ti — r and <2 — t < t < £2- 

Remark 6. For the problem of the calculus of variations (9)-(10), the Hamiltonian 
(32) takes the form H = L+p-u, with u = q and p(t) = — d^L\q] T (t) — 9gL[g] T (i+r) 
(cf. Remark 4). In this case the constant of motion with delay (38) reduces to (22) 
in the interval t\ < t < £2 — T and to (23) in the interval £2 — r < t < £2- 

4. Examples. Now we illustrate the application of Theorem 3.7 (Example 1) and 
Theorem 3.13 (Example 2). 



Example 1. Let us consider the problem 

[t~ l)f dt — >min 

(39) 



J[q(- (q(t) + q(t-l)) 2 dt 



q(t) =-t, -l<t< 0, 
q(3) = 2. 
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Because (39) is autonomous, one has invariance, in the sense of Definition 3.3, with 
rj = 1 and £ = 0. We obtain from Theorem 3.7 that 

(<K0 + g(i-i)) 2 -24(t)(2g(t) + g(i-i) + <Ki + i)) = Cl , ie[0,2], (40) 

and 

(g(t) + ( 7(t-l)) 2 -2g(t)(g(i)+g(i-l))=c 2 , is [2,3], (41) 

along any extremal q(-) £ C 1 ([— 1,3],R) of (39), where ci and c 2 are constants. 
In this case the conservation laws (40) and (41) can also be obtained by a direct 
application of Theorem 3.6. 

Example 2. Let us consider an autonomous optimal control problem with time 
delay, i.e., the situation when L and (p in (25) and (26) do not depend explicitly 
on t. In this case one has invariance, in the sense of Definition 3.11, for rj = 1 and 
£ = q = <; = 0. It follows from Theorem 3.13 that 

H{q(t),u(t),q(t-T),u(t-T),p(t)) = constant (42) 

along any Pontryagin extremal with delay (<?(•) , u(-) , £>(•)) of the problem. In this 
example the same conservation law (42) is obtained from Theorem 3.10. 
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